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Abstract. Optimization has been becoming a central of studies in math- 
ematic and has many areas with different apphcations. However, many 
themes of optimization came from different area have not ties closing to 
origin concepts. This paper is to address some variants of optimization 
problems using ontology in order to building basic of knowledge about 
optimization, and then using it to enhance strategy to achieve knowledge 
based optimization. 
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1 Introduction 

The optimization refers to choosing the best element from some set of available 
alternatives |38j . Simply, the optimization related to minimizing or maximizing a 
function by systematically choosing the values in/from/to real. In some respects 
the optimization embedded to economic, efficiency, and effectiveness. Therefore, 
in simple, a optimization problem can be defined as a function 

f-.X^R (1) 

where Bxq G X,\/xi e X such that a minimizaton is f{xo) < f{xi) or a max- 
imization /(xq) > f{xi) [53]. In general, a set of variables X is a collection of 
variables representing attributes of entities as instances in studies which need 
an optimization. Some of them are the standard variables (static), but do not 
few dynamically as options. However, in many researches and studies, or the re- 
search behaviors about optimization, those variables on fixed condition is either 
in setting or in concept, such as many examples in course books of optimization, 
such that the optimization formulation proved to be stiff, and indeed do not 
applicable. 

Most optimization-related research in the airline industry, for example, are 
about areas: network design and schedule construction; fleet assignment; aircraft 
routing; crew scheduling; revenue management; irregular operations; air traffic 
control and ground delay program !.156 . Which of all consider the green concept 
[22] ■ for example. Therefore, each time the optimization problem formulated, 
but it is not optimization. The reasons, many studies consider the properties 
of variables setting, but they are not sure the characteristics of variables, so 
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the latent variable can not be disclosed, need to both external and internal 
considerations as well as for providing impact in the optimization variables, 
such as the reliability and trusty. Therefore, this paper has a task to describe 
some problems of optimization using ontology, and to find out ties between 
problems based on adaptation concept. This paper divided into four sections, 
one remainder section is about the concept and some problem statements, and 
then they are expressed in Discussion section. 

2 The Concepts and Some Open Problem Statements 

The research in optimization area are becoming more flamboyant with the emer- 
gence of new area of studies involving resources (implicitly [50]). Such studies 
include the exploration of new set theory such as fuzzy set |75j . The optimization 
involves many themes and interest of every branch of mathematics as knowledge 
that exist today, which has the task in accordance with its purpose to iden- 
tify the new things around optimization and assessment of object relations with 
other agencies, which also involves the main agenda of life such as environment, 
human rights, social welfare, and justice, where the green computing and nano- 
technology have played their roles |3ll3l5l2l30l88 "86 96 26 1115161] . These do not 
only experienced a shift in accordance with the challenges and problems faced 
to get optimization, but also caused by changes how to approach the issues by 
the scientists. 

This shift is a response to the pressures of internal and external. Internal 
pressure is a jigsaw puzzle that is still hidden and not answered within the 
given optimization paradigm, caused by the approaches or methodologies that 
have not been able to explain phenomena or any event which can be observed, 
while the external pressure comes from the style of thought and the flow of 
thought. The flow of thought such as ontology is used to find a red thread 
between the paradigm and phenomena [124) . thus optimization studies can be 
clearly disclosed in both research opportunities and applications. Existing red 
threads include heuristic rules, inductive, and deductive. However, it is also not 
effective to directly employ to many phenomena, this is because 

1. the heuristic rule requires the scientist to define a specific rule for each 
specific type of optimization problem, thus that is not adaptive for different 
situations [Adapdation 1], 

2. the inductivity trains a scientist model individually and cannot be adapted 
to the another [Adapdation 2], and 

3. deductivity can deal with different instances simultaneously, but it cannot 
make use of the prediction [Adapdation 3]. 

One of optimization phenomena is about feasible solution (is called optimal 
solution) that minimizes or maximizes the objective function, where the feasible 
region and the objective function present convexity or not. If ([l} as objective 
function (OF), cost function or energy function does not present convexity, then 
there may be several local optima (minima or maxima), where local optima x* is 
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defined as a point for which there exists some (5 > so that for all x such that \\x— 
x*\\ (< V >) (5; the expression f{x*) (< V >) f{x) holds, whether the opposite 
is a global optima or not. Based on this conditions, there are two categories of 
optimization which always use the programming term as an emphasis on the 
use of iteration in complexity to get the solution of problem. First category is 
convex programming, i.e., optimization studies when the objective function ([T]) 
is convex and the constraints, if any, also form a convex set. In general, the 
convex programming as follow [20 . 

Definition 1 (Convex optima). Let a real vector space X together with a 
convex, real-valued function 

/ : A" ^ R (2) 

such that /(x*) < /(x), Vx e X, Elx* G X for the number /(x) is smallest, 
where X C X is a convex subset. 

In this case, ([T]) is linear and there are a set of constrainsts (SC) is speci- 
fied only linear equalities and inequalities, such that there is a poly tope if it is 
bounded. Specifically, the optimization problems form a polyhedron in condi- 
tions that (OF)-linear and (SC)-linear. Formally, these as follow |101I92| . 

Definition 2 (Linear Programming). Linear programming (LP) is problems 
in canonical form: 

max c"^x (3) 

subject to 

Ax < b (4) 

where x is vector of variables, c and b are vectors of coefficients, A is a matrix 
of coefficients. 

Lemma 1. // (0) and respect to a linear objective function and constraints 
are convex, then LP is a convex optima. 

In case, ([1} involves certain types of quadratic programs, we have optimiza- 
tion problems as follow |103l82j . 

Definition 3 (Second-Order Cone Programming). Second-Order Cone Pro- 
gramming (SOCP) is a problem of the form 

min f^x (5) 

subject to 

\\AiX + b^\\2<cf -\-di,i = l,...,m , . 

Fx^g ^ ' 

where f £ R", A, e R"'><", b, e R"', c, e R", d,e'R,Fe Rp""", g £ R^, and 
X e R" is the optimization variable. 

Lemma 2. // and respect to a linear objective function and constraints 
are convex, then SOCP is a convex optima. 
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Proposition 1. If Ai — , i — 1, . . . , m in then SOCP reduces to LP. 

Lemma [U [2] and Proposition [T] can be generalized into one conclusion as 
semidefinite programming (SDP) [84185) . where semidefinite matrices as under- 
lying variables, as follow. 

Definition 4. Let S*" is the space of all n x n real symmetric matrices. We 
define a trace, tr, for equipping the space with the inner product, i.e., 

n 

tr{A^B)^{A,B)s^^ J2 ^^j^^j- (7) 

i=i,j=i 

A symmmetric matrix is positive semidefinite if all its eigenvalues are nonneg- 
ative. 

Lemma 3. // is convex, then the positive semidefinite is a convex optima. 

Definition 2] and Lemma [3] generalize all of forms of convex programming. 
Thus, LP, SOCP and SDP can be viewed as conic programs with the appropriate 
type of cone as follow |25I142I149] . 

Definition 5. Let X is real vector space and also convex. The conic optimiza- 
tion is a convex optima with real valued function 

f-.C^R (8) 

defined on convex cone C C X , and an affine subspace % defined by a set of affine 
constraints hi{x) = 0, such that x €z C nH for the number f{x) is smallest. 

In geometry, let a monomial is a function / : R" R with dom / = R"_|_, 
i.e., f{x) = cx'^xl^ ■ ■ -x^", where c > and Oi G R. Based on this concept, we 
define the geometric programming as follow |128ll8llM] . 

Definition 6 (Geometric programming). A geometric programming (GP) 
is optimization problem of the form 

foix) (9) 

subject to 

fi{x) < l,i = l,...,m 
hj_{x) = l,i = 1, . . . ,p 

where /o, . . . , fm o,re polynomial and hi, . . . ,hp monomials. 

Lemma 4. GP is a convex optima, if and ilU\) become a sum of exponentials 
of affine functions. 

Some concepts of optimization problems above include into convex program- 
ming, and then we will define the concepts of other programming. One of them is 
quadratic programming as a special type of mathematical optimization problem 
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Definition 7 (Quadratic Programming). Let x G R". The n x n matrix 
Q is symmetric, and c is any n x 1 vector. Quadratic programming (QP) is to 
minimize (with reppect to n.) 

/(x) = Ix^gx + c^x (11) 

subject to one or more constraints of of the form 

Ax < b 



EK = d 

where indicates the vector transpose of k. 



(12) 



The notation Ax < b means that every entry of the vector Ax is less than or 
equal to the corresponding entry of the vector b. 

Lemma 5. // the matrix Q is positive semidefinite, then ill]) is a convex func- 
tion, or QP is convex optima. 

Definition 8 (Nonlinear Programming). Optimization model as non- 
linear programing is problem can be stated simply as 

maxf{x) (13) 

is to maximize some variable such as product throughput, or 

min/(x) (14) 

is to minimize a cost function, where f : i?" R, X C i?" . 

All models above are the determenistic optimization problems which are for- 
mulated with known parameters. Besides, the size of X is bounded, also variable 
with another have self setting. When the parameters are known within certain 
bounds, one approach to tackling such problem is called robust optimization. 
However the real world problems almost invariably include some unknown pa- 
rameters. The goal of optimization is to find a solution which is feasible for all 
conditions and situations and optimal in some sense. Therefore, one of frame- 
works for modeling optimization problems is by involving uncertainty. 

Ontologically, in certain optimization problems the unknown optimal solu- 
tion might not be a number or vector, but rather a continuous quantity |76I113| . 
This problem appeared because a continuous quantity cannot be determined by 
a finite number of certain degrees of freedom [15128110^ . However, such problem 
can be more challenging than finite-dimensional ones |68) . so nothing of enti- 
ties attributes depend on continuous times ever, or there are not event hold on 
long times. We know disciplines which study infinite-dimensional optimization 
problems are calculus of variations |22I28| , optimal control [31 j and shape opti- 
mization [19187147] . In constraints based optimization [55] , a solution is a vector 
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Table 1. Methods are used to solve optimization problems. 



id 


Method 


Description 


1. 


active set 11051 


A problem is defined using an objective function to 






minimize or maximize, and a set of constraints g\{x) 






> 0, . . . , gk{x) > that define the feasible region, that 






is, the set of all x to search for the optimal solution. 






Given a point x in the feasible region, a constraint 






qi(x) > is called active at x if Oiix) — and 






inactive at x if gi{x) > 0. 


2. 


ant colony 1351 


A probabilistic technique for solving computational 






problems which can be reduced to finding good paths 






through graphs. 


3. 


beam search |83l9j 


A heuristic search algorithm that explores a graph by 






expanding the most promising node in a limited set. 


4. 


conjugate gradient 


An algorithm for the numerical solution of particular 




EH 

1 J 


systems of linear equations, namely those whose 






matrix is symmetric and positive-definite 


5. 


cuckoo search [152] 


An optimization algorithm was inspired by the 






obligate brood parasitism of some cuckoo species by 






laying their eggs in the nests of other host birds 






(of other species) . 


6. 


difTerential evolution 


A method that optimizes a problem by iteratively 




|158ll59j 


trying to improve a candidate solution with regard to 






a given measure of quality. 


7. 


dynamic relaxation 


A numerical method, which, among other things, can 




ED 


be used do "form-finding" for cable and fabric 






structures. 


8. 


ellipsoid I62j 


An iterative method for minimizing convex functions. 


9. 


evolution strategy 


An optimization technique based on ideas of 




l60l 


adaptation and evolution. 


10. 


firefly algorithm 


A metaheuristic algorithm, inspired by the flashing 




|98I153| 


behaviour of fireflies. 


11. 


Frank- Wolfe 33 


A procedure for solving quadratic programming 






problems with linear constraints. 


12. 


genetic algorithm 


A search heuristic that mimics the process of natural 




|112I41| 


evolution. This heuristic is routinely used to generate 






useful solutions to optimization and search problems. 


13. 


gradient projection 


An algorithms that can be used to optimize virtually 




m 


any rotation criterion. 


14. 


harmony search 


A phenomenon-mimicking algorithm inspired by the 




|127I81| 


improvisation process of musicians for finding 






a best harmony as global optimum. 


15. 


hill climbing 


A mathematical optimization technique which belongs 




|57|95| 


to the family of local search. 


16. 


interior point 


A linear or nonlinear programming method that 




|51|14| 


achieves optimization by going through the middle of 






the solid defined by the problem rather than around 






its surface. 
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of variables that satisfies all constraints, where the constraint satisfication is 
the process of finding a solution to a set of constraints that impose conditions 
that the variables must satisfy. However, the solutions depend on Adaption 1, 
where constraint satisfaction typically identified with problems based on con- 
straints on a finite domain, or based on patterns derived from the experience in 
classification, that be local solution. 



Table 2. Methods are used to solve optimization problems (Continue) 



id 


Method 


Description 


17. 


lOSO 


A multiobjective, multidimensional nonlinear 
optimization technology. 


18. 


line search [111135] 


One of two basic iterative approaches to finding a 
local minimum x* of an objective function / : R" — >■ R. 


19. 


Nelder-Mead |125I21| 


A nonlinear optimization technique, which is a 
well-defined numerical method for twice differentiable 
and unimodal problems. 


20. 


Newton |100I53| 


A method for finding successively better approximations 
to the zeroes (or roots) of a real-valued function. 


21. 


particle swarm [150| 


A computational method that optimizes a problem by 
iteratively trying to improve a candidate solution 
with regard to a given measure of quality. 


22. 


quantum annealing 


A general method for finding the global minimum of a 
given objective function over a given set of candidate 
solutions (the search space), by a process analogous 
to quantum fiuctuations. 


23. 


quasi-Newton [77] 


A algorithm for finding local maxima and minima of 
functions. 


24. 


simplex [44] 


A popular algorithm for numerically solving linear 
programming problems. 


25. 


simulated annealing 


A generic probabilistic metaheuristic for the global 




mi 


optimization problem of applied mathematics, namely 
locating a good approximation to the global optimum of a 
given function in a large search space. 


26. 


stochastic tunneling 


An approach to global optimization based on the Monte 




mi 


Carlo method-sampling of the function to be minimized. 


27. 


subgradient 


The iterative methods for solving convex minimization 




m 


problems. 


28. 


tabu search 


A mathematical optimization method for local search 




[108] 


techniques. 



In stochastic framework, some of the constraints or parameters depend on 
random variables |113I131I160| , or this models of optimization depend on prob- 
ability distributions governing the data are known or can be estimated. The 
goal is to find some policy that is feasible for all (or almost all) the possible 
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data instance and maximizes the expectation of some function of the decisions 
and the random variables. Although, stochastic programming has applications 
in a broad range of areas (most of them in uncertainty): finance, transportation, 
social modalities, or energy. However, random event occurs only affecting first 
acitivity. 

In theoretical computer science, many themes of optimization involving com- 
binatorial [4142174] ■ that related to operations research, algorithm theory, and 
computational complexity theory. The goal is to find the best solution. How- 
ever, this optimization problems only dealing with graphs, matroids, and related 
structures, in which the set of feasible solutions is discrete or can be reduced to 
discrete |80I97I11^ . In addition to, for combinatorial optimization are designed 
metaheuristic that optimizes a problem by iteratively trying to improve a can- 
didate solution with regard to a given measure of quality [4011291155] , where an 
optimal solution is sough over a discrete search-space. However, metaheurstic do 
not guarantee an optimal solution is ever found. Therefore, many metaheuristics 
implementation in stochastic optimization [138I145IM] . 

Many models of optimization have been defined, and many methods for solv- 
ing them have been created to what(?). In modelling optimization, the existence 
of derivatives is not always assumed, therefore many methods were devised for 
specific situations. All methods are created based on smoothness of the objec- 
tive functions ((T]), like as class of combinatorial methods, class of derivative- free 
methods, class of first-order methods, class of second-order methods, see Tabel[T] 
and [21 However, all methods lie on convexity [5D]: should the objective function 
be convex over the region of interest, then any local minimum will also be a 
global minimum. So, the ontology of optimization models and their methods is 
used to describe chain one optimization problem with another into a structure 
as knowledge so that knowledge based optimization exists, i.e. a systematic ap- 
proach for the study of optimization indiscernibility, where the possibilities of 
attributes (as independent variables) will be playing [109, . 

3 Discussion 

All models of optimization (Definition mS]) came closer to Adaptation 2, and 
methods for solving them to. Few methods have shown the possibility of solution 
using Adaptation 3, among of them in implicit conditions. Of course rasionally, 
many models of optimization have been defined in one space R", where a func- 
tion employed to relate between one (may be two) variable to many variables. 
Ontologically, the real world consist of relations between multiple spaces with 
variety of dimensions. For example, each academic persons related to attributes: 
name, age, salary, papers, etc. Each paper has a set of descriptions as attribute, 
i.e., title, venue, co-author, publisher, pages, year, etc. So, a publisher as en- 
tity related to: name, city, country, etc. There is an attribute has discrete type 
(name of person) , but has relation with another atribut in different space (name 
of co-author) in probability, or there are a stochastic relation between name of 
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person and name of co-author laying (social network) on title of paper by using 
Bayesian approach [llOj . 

The optimization problems not only about looking for answers of questions: 

Is it possible to satisfy all constrains? 

Does an optimum exists? 

How can an optimum be found? 

How does the optimum change if the problem changes? 
In the opposite, about question: 

(MQ) 

Why are so many models and methods of optimization created and so few used! 

We start this discussion using one analogy: The optimization problems are 
often expressed by min^jgR /(a;) or max^jgR, /(x). Certainly, x ranges over the 
reals. What is answer for argmin^g^^^^ _i-^f{x). This asks for one (or more) 
values of x in the interval (— oo,— 1] that minimize the function. The answer 
is the undefined. This is satisfiability problem, i.e., the problem of finding any 
feasible solution at all without regard to objective value (do not satisfy (MQ)). 
This means that any feasible solution do not realiable! Why? Many optimization 
method need to start from a feasible point. What? One way to obtain such a 
point is to relax the feasibility conditions using a slack variable, with enough 
slack, any starting point is feasible. How? To minimize that slack variable until 
slack is null or negative. So, where is the positition of optimization goal? 

Theorem 1 (Extreme Value of Karl Weierstrass). If a real-valued function 
f is continuous in the closed and bounded interval [a,b], then f must attain its 
maximum and minimum value, each at least once. 

This theorem describes optimum solution exist under conditions, explicitly, 
i.e., there exist numbers c and d in [a, 6] such that: /(c) < f{x) < /(d), Va; G 
[a,b]. 

Theorem 2 (Fermat theorem). Let / : (a, 6) — > R be a function and suppose 
that xq € (a, b) is a local extremum of f . If f is differentiable at xq then f {xq) = 
0. 

Last theorem states that optima of unconstrained problems are found at sta- 
tionary points, where the first derivative or the gradient of the objective function 
is zero. In general, the optima may be found at critical points, where the first 
derivate or gradient of the function is zero or is undefined, or on the bound- 
ary of the choosed set. What? First derivative test only identifies points that 
might be optima, but it cannot distinguish a point which is a minimum from 
one that is a maximum or one that is neither. How? Do twice differentiable, 
and check the second derivatives (matrix) for unconstrained problems. There- 
fore, the conditions that distinguish maxima and minima from other stationar 
points called the second-order conditions. While the inequality-constrained op- 
timazation problems are conditioned by the Lagrange multiplier, or calculating 
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Table 3. Description of linear programming 



Name Linier Programming [Convex Optima] 


Description 


A mathematical method for determining a way to achieve the best 




outcome in a given mathematical model for some list of requirements 




represented as linear equations. 


Formula 


Canonical form: Definition [2] 




Standard form: 




1. A linear function to be maximized 




e.g., maximize ciXi + C2X2 




2. Problem constraints of the following form, i.e.. 




ai,ixi + ai,2X2 < bi 




a2,ixi + a2,2X2 < b2 




03,1X1 + 03,2X2 < bs 




3. Non-negative variables, e.g., xi > 0, X2 > 0. 




4. Non-negative right hand side constants bi > 0. 



the complementary slackness conditions based on Karush-Kuhn- Tucker condi- 
tions. Then, check the matrix of second derivatives of the objective function and 
the constraints. So, how many steps to find optimum solution in order to it is 
applicable? 

The convexity of ^ in Definition [1] makes the powerful tools of convex anal- 
ysis applicable, such as theory of subgradients lead to a particularly satisfying 
theory of necessary and sufficient conditions for optimality, based on theorem as 
follows: 

Theorem 3 (Hahn-Banach). Given a vector space V over the field R of real 
numbers, a function / : V — > R is called sublinear if f^jx) — ^f{x) for any 
7 G R+ and any x , f{x + y) < f{x) -f f{y) for any x, y E V . 

In ontology, the applicability of linear programming is proved starting in Ta- 
ble [3] In general, a standard form is usual and most intuitive form of describing 
a convex minimization problem: (1) A convex function f{x) : R" — >■ R to be 
minimized over the variable x; (2) The constraints, if any: (a) Inequality con- 
straints of the form gi{x) < 0, where the functions gi are convex, (b) Equality 
constraints of the form hi{x) — 0, where the function hi are linear. 

In optimization model, the duality theory generalize convex programming 
where methods took an effective computational. Convex programming minimizes 
convex functions, so it useful also for maximizing concave functions, see Table 
[3] and Table 01 The problem of maximizing a concave function can be reformu- 
lated equivalently as a problem of minimizing a convex function. Thus, a convex 
minimization problem written as mirix f{x) subject to gi{x) < 0, i ~ 1, . . . ,m, 
hi{x) = 0, i = 1, . . . ,p, where every equality constraint h{x) = can be equiv- 
alently replaced by a pair of inequality constraint h{x) < and —h{x) < 0. By 
this, hi{x) = has to be affine as opposed to merely being convex. If hi{x) is 
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Table 4. Description of linear programming 



Name Linier Programming [Convex Optima] 
Description A type of convex programming, a model optimiztion where objective 
is affine and the set of constraints is in afRne. 
Formula 1. Primal problem: 

Maximize c"^x subject to Ax < b, x > 0. 

2. Symmetric dual problem: 

Minimize b"^y subject to A^y > c, y > 0. 

3. Alternative primal formulation: 
Maximize c"^x subject to Ax < h. 

4. Symmetric dual problem: 

Minimize b"^y subject to A^y = c, y > 0, y > 0. 



convex, hi{x) < is convex, but —hi{x) < is concave. Therefore, the only way 
for hi{x) = to be convex is for hi{x) to be affine. The way is a transformation! 

Can we see that the optimization problems is just one problem only? What 
is answer! For linear programming, we have a solution with many methods, see 
Table El 

Table 5. Description of linear programming 



Name Linier Programming [Convex Optima] 
Description A type of convex programming, a model optimiztion where objective 
is affine and the set of constraints is in affine. 
Formula Canonic form |= 

1. Primal problem 

2. Dual problem 





Founder 


Year 


Solution Technique 


Model 
Methods 


Leonid Kantorovich 
George B. Dantzig 
John von Neumann 
Leonid Khachiyan 
Narendra Karmarkar 


1939 
1947 
1947 
1979 
1984 


Simplex Method 
Duality 

Polynomial Time 
Interior point method 



Consider an arbitrary maximization (or minimization) problem where the 
objective function /(x, r) depends on some parameters r, /*(r) = maxx /(x, r). 
The function /*(r) is the problem's optimal- value function gives the maximized 
or minimized value of the objective function /(x, r) as a function of its parameter 
r. 

Theorem 4 (Envelope theorem). Let maxx/(x, r) s.t. (7(x, r) = 0, and La- 

grangian function C{x, r) = /(x, r) — Xg{x, r), where A = (Ai, . . . , A„), g{x, r) = 
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(gi(x,r), . . . ,5„(x,r)), = (0, 



,0) e R". Then 



dn 




(15) 



This theorem expresses how the vahie of an optimal solution changes when 
an underlying parameter changes. While, the continuity of the optimal solution 
as a function of underlying parameters, i.e. 

Theorem 5 (Maximum theorem). Let X and be metric space, f : X x 
— !> R &e a function jointly continuous in its two arguments, and C : 6* — !> 
X be a compact-valued correspondance. For x € X and 9^0, let f*{0) = 



ma.x{f{x,0)\x G C{e)} andC*{e) = argmax{/(x, 6l)|x e C{e)} = {a; G C{e)\f{x, 



9) = f*{9)}. If C is continuous at some 9, then f* is continuous at 9 and C* is 
non-empty, compact-valued, and upper at 9. 

Consider the restriction of a convex function to a compact convex set, where 
the function on that set attains its constrained maximum only on the bound- 
ary. For example. Definition [6] defines that objective function and inequatlity 
constrainsts of GP can be expressed as psynomials and equality constrainsts as 
monomials. Both psynomials and monomials can be transformed into a convex 
program (LemmaU]). Other side, constrained problems can often be transformed 
into unconstrained problems by using Lagrange multipliers. 

Consider a convex minimization problem given in standard form by a cost 
function f{x) and inequality constraints gi{x) < 0, where i — l,...,m. Then 
the domain X is X = {x ^ X\gi{x) < 0,...,gm{x) < 0}. The Lagrangian 
function for this problem is L{x, Aq, . . . , Am) = f (x) + ^igi{x) -\- . . . + Amffm(a^). 
For each point x G X that minimizes there exist real number Aq, . . . , Am, 
called Lagrangian multipliers, that satisfy these conditions simultaneously, (a) x 
minimizes L{y, Aq, . . . , Am) over all y & X, (b) Aq > 0, Ai > 0, . . ., Am > 0, with 
at least one Xk > 0, and (c) Xigi{x) = 0, . . ., \mgm{x) — 0. For instance, if there 
is a strictly feasible point, namely a point z satisfying gi{z) < 0, . . . ,gm{z) < 0, 
then must be assigned Aq = 1. Conversely, if some x G X satisfies (a)-(c) for 
Aq, . . . , Am with Ao = 1, then x is certain to minimize ([1}. Therefore, 

Lemma 6. Three following statements is equivalent. 

1. If a local minimum exists, then its is a global minimum. 

2. The set of all minima is convex. 

3. For each strictly convex function, if the function has a minimum, then the 
minimum is unique. 

Proposition 2. A set of problems that consist of least squares, LP, QP, Conic 
Optimization, GP, SOCP, SDP, Quadratically Constrained Quadratic Program- 
ming, and Entropy Maximization are convex optima if and only if can be trans- 
formed into convex minimization problems by changing variables. 
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The last proposition is typically interpreted as prividing conditions for opti- 
mization problems, where their ontology describe as follow: 



Optimization problems \= Convex optima H 

\= Conic Programming f H 

\= LP Lemma It H 

\= SOCP Lemma 2 t Prop. 1 

h SDP Lemma 3 ± 

1= CP Lemma 4 

^ QP Lemma 5 

\= Non - LP 



\= Stochastic Programming 
1= Fuzzy Programming 
1= ? Programming 
Opt. Indiscernebility |= Incomplete Programming 

To complete the interpretation of optimization problems and to understand 
the incomplete with them, some considerations have formulated as advice |89] . 
i.e., (a) the model of optimization be ready in close with strategic stakeholder 
with understanding the organization or environment; (b) the model of optimiza- 
tion is designed to adapt task at hand and to the cognitive capacity of the 
stakeholder; (c) the model become familiar with the various logics and prefer- 
ences prevailing in the organization or many other environments; (d) the model 
of optimization problems must be formulated in comportable and a framework 
where many methods can be solved them; (e) the model optimization problems 
can be prepared to modify or develop a new version, change the framework in 
order to accordance with any method; (f) each model can give the options to 
select the making decisions; (g) the models can express the respecting implicitly 
become explicit. 

Conjecture 1. The optimization in incomplete has optimum solution. 
4 Conclusion 

Throughout the ontology of optimization problems were in close connection with 
the principles and findings of the science, philosophy, and arts. It can be noticed 
that optimization problems are a reflection of pictures respecting to entities, 
where the ontology is the beginning of philosophy, the scratch of art, the formal- 
ization in science, to generalize knowledge behind a model of optimization. 

Remark 1. The complete is dual of incomplete. 
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